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Abstract 


"ON  SOLVING  BI -CRITERION  MATHiMATICAL  PROGRAMS" 

Artbiir  M.  Gcoffrion 

Western  Management  Science  Institute 
TJniversity  of  California,  Los  Angeles,  California  90024 

It  often  happens  in  applications  of  mathematical  programming  that 
there  are  two  incommensurate  objective  functions  to  be  extremjzed,  rather 
than  just  one.  One  thus  encounters  bi-criterion  programs  of  the  form 

Maximize  h(f^(x),  f^M), 

X  e  X 

where  h(»,*)  is  a  (nonlinear)  increasing  utility  indicator  function 
defined  on  the  possible  pairs  of  outcomes  of  the  concave  objective  functions 
f^  and  fg,  and  x  is  a  decision  n-vector  constrained  to  the  couvex 
set  X.  In  this  paper  it  is  shown  how  such  programs  can  be  nvimerically 
solved  if  a  parametric  programming  algorithm  is  available  for  the  parametric 
sub -problem 

Maximize  or  fj^(x)  +  (l-a)  fgCx)  ,  0  <  a  <  1, 

X  e  X 

Thus  when  the  parametric  sub-problem  is  a  parametric  linear  program,  for 
example,  the  nonlinear  (and  perhaps  even  non-concave)  bi-criterion 
program  can  be  solved  by  a  modification  of  a  stock  parametric  linear 
programming  routine.  An  inherent  advantage  of  the  present  approach  is  that 
it  yields  as  a  by-product  a  relevant  portion  of  the  "tradeoff  curve"  between 
f^  and  fg.  When  h  is  quasiconcave,  as  is  usually  the  case,  it  is  shown 
that  certain  computational  economies  are  possible.  Outlines  of  six  algorithms 
for  solving  (l)  under  various  special  assumptions  are  presented  to  illustrate 
the  application  of  the  theory  developed  herein.  They  are  based  on  parametric 


ii 

linear  programming,  Wolfe’s  method  of  parametric  quadratic  programming, 
and  Geoffrion’s  method  of  parametric  concave  programming.  Finally,  two 
extensions  are  indicated:  one  designed  to  relax  the  convention  that 
h  must  be  increasing  in  each  of  its  arguments  rather  than  decreasing  in 
one  or  both,  and  the  other  to  permit  nonlinear  scale  changes  to  be  made  on 
the  f^  for  convenience  in  solving  the  parametric  sub-problem.  These 
extensions  greatly  extend  the  domain  of  applicability  and  efficiency  of 
the  present  approach. 
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’^sarrr: 


ON  SOLVING  BI -CRITERION  MATHET-IATICAL  PROGRAMS 


In  this  paper  we  study  hi -criterion  programming  problems  of  the  form 

(,l)  Maximize  h(fj^(x), 

X  e  X 

where  and  fg  are  real- valued  concave  (see  footnote  l)  criterion 

(payoff)  functions  of  the  n-vector  x  of  decision  variables  that  are 
constrained  to  lie  in  a  convex  subset  X  of  and  h  is  a  real- 
valued  increasing  (i.e.,  monotone  non-decreasing  in  each  argument)  ordinal 
utility  indicator  function  defined  on  the  pairs  of  achievable  values  for 
f^  and  fg.  We  present  a  method  for  solving  (l)  based  on  any  known  para¬ 
metric  programming  algorithm  for  the  parametric  s’  V -problem 

(P  Of)  Maximize  ^  f,(x)  +  (l-^)  f2(x)  , 

X  e  X 

where  the  parameter  varies  over  the  unit  interval.  When  f^  and 
are  linear  and  X  is  a  convex  polyhedron,  for  example,  (l)  is  reduced 
essentially  to  a  standard  parametric  linear  program  even  though  h  is 
nonlinear.  Thus  parametric  linear  programming  routines  can  be  modified  to 
solve  this  important  class  of  nonlinear  (even  non-concave)  programs.  VIhen 
h  is  also  known  to  be  quasiconcave  (i.e.,  there  is  a  diminishing  marginal 
rate  of  substitution  between  f^  and  f2),  a  property  shared  by  most 
utility  indicator  functions  arising  in  practice,  it  is  shown  how  to  sub¬ 
stantially  reduce  the  amount  of  computational  work  necessary  to  solve  (l). 
After  the  necessary  theory  is  developed,  it  is  used  to  construct  outlines 
of  six  algorithms  for  solving  (l)  under  various  assumptions  on  f^,  fg, 
and  X  .  Two  are  based  on  parametric  linear  programming  [5],  two  on 
Wolfe's  method  of  parametric  quadratic  programming  [l3],  and  two  on 
Geoffrion's  method  of  parametric  concave  programming  [6].  Finally,  two 
extensions  are  presented:  one  designed  to  relax  the  convention  that  h 
must  be  increasing  in  each  of  its  arguments  rather  than  decreasing  in  one 
or  both,  and  the  other  to  permit  nonlinear  changes  of  scale  to  be  made 
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on  the  so  as  to  facilitate  solving  (P^).  These  extensions 

enlarge  the  domain  of  successful  applicability  of  the  present  approach,  and 
lead  to  efficient  computational  algorithms  for  a  large  class  of  mathematical 
programs  that  can  be  written  in  the  form  of  (l)  (e.g.  linear  fractional 
programs  [7^8],  target  assignment  problems  [ll],  and  stochastic  programs  [lO]). 

Motivation 

Although  bi-criterion  programs  may  be  motivated  in  terms  of  consumer 
demand  theory  of  classical  economic  analysis,  the  author's  interest  derives 
from  a  concern  for  an  underdeveloped  aspect  of  modern  mathematical  pro¬ 
gramming  •  how  to  deal  with  multiple  objective  (criterion)  functions.  In 
practical  applications  of  linear  and  nonlinear  programming,  alternative 
decisions  very  often  have  effects  that  cannot  be  naturally  measured  on  a 
common  scale.  Consider  two  such  effects,  as  represented  by  the  criterion 
functions  f^(x)  and  f^y^)}  and  let  it  be  desired  to  maximize  both  in 
the  sense  that,  fora  fixed  level  of  one,  as  much  as  possible  of  the  other 
is  desired.  Unless  f^  and  f^  happen  to  attain  their  maximum  simultaneously 
on  X  ,  some  compromise  between  the  two  criteria  must  be  worked  out.  F?ve 
ways  of  proceeding  are;  (i)  ignore  one  criterion  and  maximize  the  other- 
(ii)  maximize  one  criterion  subject  to  the  additional  constraint  that  the 
other  meet  or  exceed  some  specified  minimal  level-  (iii)  maximize  a 
weighted  combination  of  the  two  criteria  (without  loss  of  generality,  the 
result  is  a  problem  of  the  form  (P^y)  for  some  fixed  ot  in  the  unit 
interval-  this  amounts  to  forcing  one  criterion  to  be  measured  additively 
in  the  same  units  as  the  other)  (iv)  determine  a  preference  ordering  over 
the  attainable  payoff  set,  represent  it  by  a  (usually  nonlinear)  utility 
indicator  function  h(f^, fg),  and  solve  (l):  and  (v)  construct  the 
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admissible  portion  of  the  attainable  payoff  set,  decide  which  point  in 
it  is  most  preferred,  and  determine  a  corresponding  element  of  X  .  Ibe 
attainable  payoff  set  is  the  set  of  points  (fj^(x),f2(x))  in  E  corresponding 
to  some  X  in  X  ,  and  the  admissible  portion  of  it  (briefly,  the  "admissible 
set")  consists  of  those  points  with  the  property  that  one  criterion  cai.  be 
increased  only  at  the  expense  of  a  decrease  in  the  other. 

Procedures  (i),  (ii)  and  (iii)  are  computationally  the  simplest, 
though  often  they  lead  to  unrealistic  reformulations  of  the  original  problem. 
The  fo\irth  approach  can  be  considered  a  generalization  of  the  third,  and 
has  the  potential  of  being  quite  realistic.  It  suffers,  however,  from 
difficulties  introduced  by  the  function  h  .  Not  only  must  h  be  determined, 
presumably  by  prolonged  introspection,  but  its  composition  with  f^  and 
fg  can  lead  to  a  difficult  maximization  problem.  Assuming  that  a 
computational  method  is  available  for  constructing  the  admissible  set 
procedure,  (v)  obviates  the  need  for  determining  a  preference  ordering 
over  the  entire  attainable  payoff  set  --  for  it  is  only  necessary  to 
determine  the  most  preferred  point  of  the  actual  admissible  portion 
thereof  arising  in  the  context  of  a  specific  problem.  An  important  side 
benefit,  not  automatically  available  under  any  of  the  other  procedures,  is 
full  knowledge  of  the  sensitivity  of  each  criterion  to  the  pursuit  of  the 
other.  Fortunately,  in  a  number  of  important  cases  the  amount  of  comp¬ 
utational  work  involved  in  computing  the  admissible  set  is  not  much  greater 
than  that  for  (iii). 

We  shall  develop  and  exploit  the  intimate  relationship  between  (iii), 

(iv),  and  (v)  and  the  availability  of  parametric  programming  algorithms  for 
(P^)  to  derii^e  a  solution  technique  for  (iv)  based  on  computing  a  (usually 
small)  part  of  the  admissible  portion  of  the  attainable  payoff  set.  In 


addition  to  providing  a  convenient  computational  approach,  this  method 
for  solving  (l)  has,  of  course,  the  inherent  advantage  of  yielding  as  a 
by-product  a  relevant  portion  of  the  admissible  set.  This  suggests  the 
following  i.ybrid  approach:  make  a  rough  determination  of  h  (preferably 
having  a  simple  analytic  form),  solve  the  resulting  problem  (l),  and 
examine  the  by-product  portion  of  the  admissible  set  to  see  whether  it 
provides  any  reason  to  doubt  that  the  indicated  solution  is  in  fact  the 
most  preferred  --  if  so,  then  more  of  the  admissible  aet  can  bo  computed  and 
a  revised  solution  chosen  In  the  spirit  of  (v). 

DEVELOIMENT 

In  addition  to  the  assumptions  stated  in  the  first  paragraph,  it 
will  be  convenient  to  avoid  questions  of  the  attainment  of  suprema  by 
assuming  throughout  this  paper  that  the  feasible  region  X  is  compact 
(closed  and  bounded)  and  non-empty  as  well  as  convex,  that  the  f^  are 
continuous  as  well  as  concave^ on  X  ,  and  that  h  is  continuous  as  well 
as  increasing  on  the  attainable  payoff  set  f[X],  We  denote  by  f  the 
vector-valued  function  (f^,  f^)j  and  by  f[x]  the  image  in  E  of  X 
vinder  f  .  A  point  x°  e  X  is  said  to  be  efficient  if  and  only  if  there 
does  not  exist  another  point  x'  e  X  such  that  f^(x’)  >  f^(x°),  i  =  1,2, 
with  strict  inequality  holding  for  at  least  one  i  ;  in  other  words, 

1/  A  function  f(x)  on  a  convex  set  X  is  said  to  be  concave  if  x\ 
x^"  e  X,  yT  f  imply  f(tx^  +  (l-t)  x^)  >  tf(x^)  +  (l-t)  f(x^)  for 
all  0  <  t  <  1  .  An  important  property  of  concave  functions  is  that 
a  non-negative  linear  combination  of  such  functions  is  always  concave. 

This  property  is  not  shared  by  quasiconcave  functions  (see  footnote  ^4-). 
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if  and  only  if  f(x°)  is  in  the  admissible  set.  The  set  of  optimal 
solutions  of  (Pjy)  for  a  fixed  value  of  is  denoted  by  X*(Q?),  and 
any  n-valued  function  x*(o^)  on  [O,  l]  that  satisfies  x*(c^)  ^  X*(Qf)  for 
each  Of  is  called  an  optimal  solution  function  of  (P(^)» 

For  brevity,  the  basic  assumptions  stated  above  will  not  be  explicitly 
mentioned  in  the  statements  of  the  formal  lemmas  and  theorems  below. 
However,  the  proofs  will  be  explicit  about  which  assumptions  are  actually 
used. 

The  r?-:ider  will  find  it  convenient,  in  following  the  development 
below,  to  keep  Fig.  1  in  mind.  It  represents,  in  payoff  space,  a 
simplified  typical  situation  that  might  occur  under  tur  assumptions.  The 
attainable  payoff  set  is  the  interior  of  the  closed  curve  ABCDEA,  the 
admissible  set  is  the  heavy  curve  ABC,  and  parts  of  selected  level 
curves  of  h  have  been  draw'n  and  labeled.  If  x*  is  optimal  in  (l), 
then  obviously  h(f(x*))  =  13  and  f(x*)  is  point  B. 


FIGURE  1 


6 


The  first  two  lemmas  provide  the  primary  motivation  for  a 
computational  approach  to  solving  (l)  in  terms  of  the  parametric  program 
(P  ») .  They  can  easily  be  interpreted  in  terms  of  Fig.  1. 

Lemma  1; 

At  least  one  point  at  which  h(f(x))  achieves  its  msoclmum  over  X 
is  efficient. 

Proof; 

By  the  compactness  of  X  and  the  continuity  of  f  and  h,  (l)  has 
at  least  one  optimal  solution  Similarly,  there  exists  a  point 

x’  which  maximizes  f^(x)  +  fgCx)  over  X  subject  to  the  additional 
constraints  f^(x)  >  f^(x°),  i  =  1,2.  Now  x’  is  easily  seen 
to  be  efficient,  for  the  contrary  contradicts  the  choice  of  x’ .  Finally 
we  observe  that  x'  must  also  solve  (l)j  for  x'  is  feasible  in  (l),  and 
fj(x')  >  f^(x'^),  i  -  1,2,  Implies,  by  the  fact  that  h  is  increasing, 
that  h(f(x'))  =  h(f(x°)). 

Lemma  2; 

If  x^  is  efficient,  then  there  exists  a  number  oP  in  the  unit 
Interval  such  chat  x°  is  an  optimal  S'^lutlon  of  (P 
Proof; 

The  proof  uses  the  concavity  of  f  and  convexity  of  X  in  an  essential 
way,  and  is  an  application  of  a  basic  separation  property  of  convex 
sets.  It  con  be  found,  for  example,  in  Karlin  [9]  or  Geoffrion  [b]. 

Lemmas  1  and  2  imply 

Theorem  1;  An  optimal  solution  of  (l)  is  found  among  the  optimal 
solutions  of  (P  or)  for  some  o'  in  the  unit  interval.  More  precisely. 


if  o*  is  optimal  in 
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(2)  Maximize  H(q')  , 

Of  e  [o,l] 

where  we  define  H  (o^)  on  the  xmit  interval  by 

(3)  H(a)  =  Maximum  h(f(x)), 

X  e  X*(a) 

then  (l)  is  solved  by  any  point  x  e  X*(a*)  satisfying  h(f(x))  =  H(q'*). 

That  HCa)  Is  well-defined  follows  from  the  non-emptiness  and 
compactness  of  X  and  the  continultjr  of  f  and  h,  which  imply  that 
h(f(x))  is  continuous  on  the  non-empty  rnd  compact  set  X*(a),  H(cv) 
achieves  its  maximum  by  Lemmas  1  and  2  or  by  the  fact  that  it  can  he  shown 
to  be  an  upper  semi -continuous  function  on  the  compact  set  [0,lj. 

The  computational  usefulness  of  (2)  depends  primarily  un  how  readily 
H(o)  can  be  computed  on  the  xinit  i/iterval.  If  it  can  be  computed  easily, 
t}ien  (2)  is  likely  to  be  a  quite  efficient  means  of  solving  (l),  for 
finding  the  maximum  of  H(Q^)  is  but  a  one-dimensional  maximization  problem. 
Before  taking  up  the  question  of  how  to  compute  H(a),  we  point  out  an 
easy  prrtlal  converse  of  Leraa  2  that  portly  justifies  the  assertion  made 
earlier  concerning  the  availability  of  a  portion  of  the  admissible  set  as 
a  by-product  of  the  Cf^lcnlations  for  solving  (l'). 
lemira  3: 

Every  point  of  X*(q')  is  efficient  when  or  satisfies  0  <  o;  <  l. 

Some  point  of  X*(o)  is  efficient  when  o  =  0  or  1. 

Computing  H(cy) 

Lee  U'  be  fixed  in  the  unit  Interval.  It  mi^t  be  feared  that 
computing  H(o)  requires  not  only  finding  all  optimal  solutions  of  (P  o') 
in  order  to  get  X*(a),  but  also  solving  a  maximization  problem 
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of  the  same  form  as  (l)  itself;  for  it  was  noted  that  X*(a)  :'.s  a 

non-empty  and  compact  subset  of  X,  and  from  the  convexity  of  X  and 
the  concavity  of  of  f^(x)  +  (l-c')  follows  that  X*(a)  is 

also  convex.  Fortunately,  however,  it  turns  out  that  computing  H(Qf) 

Is  not  nearly  so  difficult  as  this  ohservat:' on  would  seem  to  indicate. 

The  results  of  the  following  theorem  show  that  K(a)  con  usually  he 
compated  on  [o,l]  with  little,  if  any,  extra  work  beyond  finding  by 
paremetric  programming  any  optimal  solution  function  x*(q^)  of  (P 
on  [O, l]. 

Theorem  2; 

A.  Let  Of  be  fixed  in  the  unit  interval.  If  (P  o^)  has  a  unique 
optimal  solution  x*(q^),  then  H(Qf)  =  h(f(x*(Q'))). 

B.  H(0)  =  h(f(x))  for  any  efficient  point  x  e  X*(0). 

H(i)  =  h(f(x))  for  any  efficient  point  x  e  X*(l), 

C.  Assume  that  either  f^^  or  (or  both)  is  linear  on  a  lino 

segment  in  X  only  if  it  is  constant  on  it.  Then  for  each  o 

satisfying  0  <  <  1,  we  have 

H(q')  =  h(f(x))  for  any  point  x  e  X*(a), 

D.  Let  x*(a)  be  anv  optimal  solution  function  for  (P  or)  cn  [o, l]  that 

is  continuous  everywhere  except  possibly  for  a  finite  number  of 
simple  discontinuities.  For  each  point  of  discontinuity, 

define  x*(^*)  x*(c,")  as  the  left-hand  (unless  a’  =  O)  and 

ri^t-hand  (unless  a’  --  l)  limits  of  x*(o)  at  QP,  respectively.  Then 

1.  H(of)  =  h(f(x*(o')))  at  every  point  of  continuity  in  [0,l]; 

2.  H(0)  =  h(f(x*(0)))  if  0  is  a  point  of  discontlnuicy; 

3.  K(i)  =  h(f(x*(l)))  if  1  is  a  point  of  discontinuity; 
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4.  If  a'  is  a  point  of  discontinuity  satisfying  0  <  of  <  1,  then 

(3.1)  H(Qf')  =s  Maximum  h(f(  t  x*  (o^')  +  (l-t)  x*(of')  ))  and 

t  e  [o,l] 

(3.2)  H(Q'')  =  Maximum  h(t  f(x»(a'))  +  (l-t)  f(x*(of'))  ). 

t  e  [0,1] 

Before  undertaking  to  prove  the  results  of  this  theorem,  we  remark 
that  part  A  applies,  for  example,  when  oi  f^(x)  +  (l-Of)  f2(x)  is 
strictly  concave j  that  part  C  applies,  for  example,  if  one  of  the  fj^ 
is  a  negative  semi -definite  quadratic  form;  and  that  part  D  applies  to 
all  parametric  programming  algorithms  known  to  the  author  in  the  sense 
that  when  they  are  applicable  to  (P  Q^),  they  all  produce  an  optimal  solu¬ 
tion  function  x*{ot)  that  is  continuous  everywhere  on  the  unit  interval 

2/ 

except  possibly  for  a  finite  number  of  simple  discontinuities,-  Note 
that  in  part  D,  to  compute  H(a)  for  a  point  of  discontinuity  one  has 
a  choice  of  solving  either  of  the  two  one-dimensional  maximization 
problems  (3.1)  and  (3.2). 

The  burden  of  the  remainder  of  this  subsection  is  to  establish  the 
results  of  Theorem  4. 

Part  A  is  trivial.  Part  B  is  nearly  so,  and  may  be  seen  as  follows. 
The  efficient  points  in  X*(0)  are  obviously  precisely  those  that 
maximize  f^  over  X*(o).  Since  fg  is  constant  over  X*(o)  and 
h  is  increasing,  h(f)  is  maximized  over  X*(0)  •  where  f^  is 

maximized.  Thus  H(o)  =  h(f(x))  for  any  efficient  point  x  in  X*(o). 

A  similar  argument  proves  the  assertion  regarding  H(l).  Toward  proving 
parts  C  and  D,  it  is  convenient  to  write  (3)  in  the  alternate  form 

2/  In  fact  one  suspects  that  the  exploitation  of  possible  continuity 


in  the  optimal  solution  of  (P  Qf)  as  Qf  varies  is  necessary  for  a 
successful  parametric  programming  algorithm. 
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(4)  H(ci')  =  Maximum  h(y)  , 

y  e  f[x*(Q')] 

where  f[X-'^(a)]  is  the  image  of  X*(o^)  under  f  and  y  is  a  generic 

^  ^  t.2 

e-^ement  of  E  . 

Lemma  h: 

For  each  fixed  value  of  a  satisfying  0  <  a  <  1,  fLX*(a)]  is  either  a 

2 

singleton  or  a  compact  line  segment  of  non-zero  length  in  E  with  ncr- 

1  2 

mal  {o!,  1-a).  In  the  latter  case,  if  f(x  )  and  f(x  )  are  the  end- 

12  1  2 
points  of  the  line  segment,  then  f(tx  +  (l-t)x  )  =  t  f(x  )+(l-t)  f(:i  ) 

for  all  t  satisfying  0  <  t  <  1. 

Proof; 

Let  0  <  0^  <  i  be  fixed.  By  definition,  X*(cii')  is  the  optimal 
solution  set  of  Hence 

0?  f^(x)  +  (1-a)  f2(x)  =  via) 

for  all  X  e  X*(q'),  where  v(o')  is  the  optimal  value  of  (P(^)* 

Hence  f[X*(Q')]  is  a  subset  of  the  line  {y  =  (yx’^’2^  ^ 

a  y^  +  (l  -  O')  y^  =  v(cv)}.  Suppose  that  f(x  )  ^  f(x  ),  where 
1  2 

x  ,  X  e  X*(Q().  Let  t  be  any  real  number  in  the  unit  interval.  Then 
(tx^  +  (l-t)  x^)  e  X*(Qf)  by  convexity,  and  f^  (tx^  +  (l-t)  x^)  >  tf^(x^)+ 
(l-t)  f^(x  ),  i  =  1,2,  by  concavity.  Hence 

v(q')  =  Q'f^(tx^  +  (l-t)  x^)  +  (l-a)  f2(tx^  +  (l-t)  x^) 

>  a  (tf^(x^)  +  (l-t)  f^(x^)) 

+  (1-a)  (tfg  (x^)  +  (l-t)  f2(x^)  ) 

=  t(o'  f^(x^)  +  (l-Qf)  f2(x^)  ) 

+  (l-t)  (a'f^(x^)  +  (1-a)  f2{x^)) 

=  t  v(q')  +  (l-t)  v(c^)  =  v(a')  , 
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from  which  it  follows  (recall  that  0  <  v  <  l)  that 

f(tx^+  (l-t)  x^)  «  (1-t)  f(x^). 

It  roaalns  only  to  show  that  f(X*(®)l  is  compact.  This  follows 

immediately  fton  the  continuity  of  f  and  the  compactness  of  X*ia)„ 

This  leraa  implies  that  to  compute  H(cif)  for  fixed  o  satisfying 

0  <  Of  <  1  it  is  sufficient  to  know  at  most  two  points  in  X*(of):  any 

1 

one  point  if  f[X*(of)]  is  a  singleton,  and  any  two  points  t.nd  x'“ 
which  each  map  into  a  different  endpoint  otherwise.  In  the  first  case, 
from  (4)  we  see  that  H(a)  «  h(fvx))  for  any  x  «  X*(cr);  and  in  the 
second  case,  we  have 

(5)  H(cr)  R  Maximum  h(t  f(x^)  +  (l-t)  f(x^)  ) 

t  c  (0,1] 

or,  interestingly  enou^,  the  alternative 

(6)  H(Qf)  «  Maximum  h(f(tx^  +  (l-t)  x^)  ). 

t  e  [o,l] 

Fiom  (U),  we  see  that  the  next  lemma  implies  Th.  2C. 

Lemma  5; 

If  either  f^  or  f2  (or  both)  is  linear  on  a  line  sclent  of  X 
only  if  it  la  constant  on  it,  then  f[X*(a)]  Is  a  singleton  for  each 
fixed  a  satisfying  0  <  Qf  <  1. 

Proof; 

Let  Of  be  fixed,  0  <  Qf  <  1,  and  let  one  of  the  f^,  say  f^^, 
satisfy  the  hypothesis.  Suppose  that  f[X*(ar)]  is  not  a  singleton. 

Ihen  there  are  points  x^,  x^  e  X*(®)  such  that  f(x^)  /  f(x^), 
and  by  I«mma  4  f(x)  is  linear  on  the  line  segment  running  from  x"  to 
x^.  By  hypothesis,  then,  fj^(x^)  ■  fj^(x^),  and  so  f2(x^)  ^  f^y^). 

If  f2(x^)  <  (re8p>)  fg(x"),  then  x^  (resp.  x°)  is  not  efficient,  which 
contradicts  tiic  known  efficiency  (by  Lemma  3)  of  both  x°  and  x^. 
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Remark ;  A  non-trivial  example  of  a  criterion  function  that  is 
linecx  on  a  line  segment  of  X  only  if  it  is  constant  on  it,  is  a 
negative  semi-definite  quadratic  form.  If  the  other  criterion  function 
is  arbitrary,  say  linear,  then  f[X*(cy)]  must  be  a  singleton  even  though 
X*(q')  need  not  be  a  singleton. 

Toward  proving  part  D  of  Th.2,  we  establish 
Lemma  6; 

If  X*  (q^)  is  any  optimal  solution  function  for  (Po^)  on  [O,  l],  then 
f^(x*  (o'))  (resp.  f2(x*(G'))  )  is  monotonically  non-decreasing  (resp. 
non-increasing)  on  [O, l]. 

Proof; 

Let  such  that  0  £  definitions  of 

x*(Qfj^)  and  x*(o!^), 

(7)  0^2  f2^x*(a^)  )  <a2  f^(x*(a2))  +  (l-a^)  f^(y*(a^)) 

and 

(8)  ^  )  <  0!^  f3^(x*(a^))  +  (l-a^)  f^Cx^fa^^). 

Multiplying  (?)  by  (l-QJ^)  and  (8)  by  (l-^'g)  and  adding,  after  rear¬ 
rangement  one  obtains  )  "  f^(x*(Q'2))  )  <  0  , 

from  which  it  follows  that  f^(x*  (o^^)  )  <  f^(x*  (o^g)  ).  Similarly, 
by  multiplying  (j)  by  and  (8)  by  o^g  and  adding,  one  obtains 

that  f2(x*  (cv^)  )  >  f2(x*  (Q'2)  )  . 

Lemma  7: 

3/ 

X*(q?)  is  ail  upper  semi -continuous  mapping—  on  [o,  l]  . 


The  definition  of  upper  semi-continuity  for  set-valued  functions 
that  w(;  use  is  that  of  Debreu  [3].  As  applied  to  X*(a),  upper 
semi-continuity  at  Q'^^[o,l]  means:  <  or'^  >  -  where  Qf'€[o,l], 
and  <  x*(Qf'^)  >  “*  x°,  where  x*(o!'^)  ^  X*{o/^),  implies  x^  ^  X*(^^)  . 
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Proof; 

Apply  Th.  h  of  sec.  1.8  of  Debreu  [3>  p.  191  to  (P^)  . 

Lemma  8. 

Let  be  any  optimal frlution  function  for  (P^^,)  that  is 

continuous  on  the  unit  interval  except  possibly  for  a  finite 

number  of  simple  discontinuities.  At  each  a  satisfying  0  <  <  1* 

O  o  Q 

A.  If  x*(a)  Is  continuous  at  oi^,  then  f[X*(Q?^)]  is  a  singleton; 

B.  If  x*(Q^)  has  a  simple  discontinuity  at  then  ^ 

lire  x*(q?)  and  x*(a  )  =  11m  x*(Q')  are  both  in  ),  and 

a  -*  a  -  °Q-*Q'+  ° 

0  o 

f[X*(a^)]  is  a  compact  line  segment  (possibly  of  zero  longih) 
with  end  points  f(x*(cv^)  )  and  f(x*(o^)  ). 

At  the  endpoints  of  the  unit  interval; 


C.  lim 

a  -*0-¥ 

X*(Of) 

is 

in 

X'^(o)  and  is  efficient; 

L.  lim 
a  -♦  1- 

X*(Q') 

is 

in 

X^f(l)  is  efficient. 

Lroof ; 

Let  x^i'y)  be  continuous  at  satisfying  0  <  <  1.  Suppose, 

contrary  to  A,,  that  there  exists  x°  e  X*(a^)  such  that  f(x^)  ^  f(x*(Qf^)). 

Since  f(x°)  <?.nd  must  both  lie  on  a  line  through  fCx*^) 

with  normal  ,  1-Q^  ),  either  fT(x°)  <  fT(x*(Q'  ))  or  f, ))  <  fi(^^) 
o  0  1  1  o'  1  o  1 

In  the  first  case,  by  the  continuity  of  f^(x*(Q'))  at  there  exists 

a  number  ^  satisfying  O'  <  such  that  f^(x*(a))  >  f^(x'^).  But  this 

contradiccB  the  raonotonicity  of  f^  proved  in  Lemma  6.  A  similar 

contradiction  can  be  obtained  in  the  second  case.  This  proves  pant  A. 

Let  x*(o')  have  a  simple  discontinuity  at  a  point  satisfying 

0  <  o'^  <  Ir  By  Lemma  f[X*(Qf^)]  is  a  compact  line  segment.  Lenote 
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lim  x*(a)  (resp.  lin  x*(a))  by  x*(q(  )  (resp.  x*  (a  )  ),  FVcm 
Qf-*a-  «-»«♦  -o  o 

o  o 

Lemma  7,  x*(of  )  pnd  x*(a  )  are  In  X*(or  ).  It  remains  to  show  that 
'  —  o  o  o 

f(x*(®jj)  )  *nd  )  ere  the  endpoints  of  f(X*(®Q)l.  Suppose 

the  contrary.  Then  there  exists  «  X*(cr  )  such  that  f,(x°)  <  f,(x*(Q'  )) 

and  fgCx®)  >  or  f^(x^a^))  <  fj^(x°)  and  f2(x*(af^))  >  fj^(x°). 

We  shall  consider  the  first  case  and  construct  the  contradiction  that  there 
exists  a  value  of  cr  such  that 

a  fj^(x°)  ♦  (1-a)  fgCx®)  >  Of  fj^(x*(of))  +  (l-«)  yx*(a)). 

A  similar  construction  leads  to  a  contradiction  for  the  second  case. 

For  all  a  «  (o,l),  we  have  or(f^(x®)  -  fj^(x*(cr))  ) 

*  »t,)  (»j^(x°)  -  fjtlc*(ot))  ) 

♦  (l-«*  -  or^)  (f2(x®)-f2(x*(oi)))  .  (.  .  <x^)  .  fj(x*(«)) 

.  -  faCx")]  ♦  ("-oCfiCx®)  -  fi(x*(«)))  ♦  (l-oi^)(tj(x'>)  -  fg(x*<o)))) 

>  tf^(x°)  -  fj(x«<«))  +  f2(x»(or))  .t^ix")  ]. 

where  the  last  inequality  follows  from  the  fact  that  the  quantity  In  curly 
brackets  is  non«negatlve  (recall  that  x°  solves  (Po'^)).  By  the  left 
continuity  of  f(x*(®))  at  and  the  fact  that  (fj^(x°)  -  and 

(f«  (x*  (a  ))  -  f*(x°))  ere  both  negative,  the  desired  inequality  is 

c  —  O  c 

establiched  for  eill  o  less  than  but  sufficiently  near  oc  .  This  completes 
of 

the  proof  /  part  B . 

Finally  we  prove  part  C.  A  similar  argument  proves  part  D.  By 

Lemma  7,  x*(0)  ■  lim  x*(®)  !•  in  X*(0).  Suppose  that  x*(0)  is 

a  -*  Of 

not  efficient.  Then  there  exists  a  point  x°  *  X  such  that 
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fj^(x°)  >  fj^(x*(0))  and  fgCx®)  =  f2(x*(0))  (since  x*(o)  solves  (P^), 

fg(x°)  >  f2(x*(0))  1®  impossible).  Thus  x°  «  X*(0).  Let  «>  0  be 
such  that  fj^(x°)  >  IM®  contradicts  the  monotonicity  of 

f^  established  in  Lemma  6. 

Th.  2D  is  established  by  parts  A  and  B  of  Lemma  8  in  conjunction 
vith  Lemma  ^  and  parts  C  and  D  of  Lemma  8  in  conjunction  vlth  Th.  2B. 

The  case  in  which  h  is  quasiconcave 

In  this  sub-section  ve  introduce  an  addltloneil  hypothesis  on  the  utility 
indicator  function  h  which  permits  attention  to  be  restricted  to  a  (hopefully 
small)  subinterved  of  [Ofl]  when  (2)  is  being  executed.  We  assume  now  that  h 
is  quasiconcave^  on  the  convex  huU^  F  of  the  admissible  payoff  set. 
Quaslconcavity  is  a  weaker  property  than  concavity,  and  is  almost  universally 
assumed  as  a  property  of  utility  indicator  functions  in  consvimer  demand  theory 
of  traditional  economic  analysis.  For  further  discussion  of  quaslconcavity, 
see  Arrow  and  Enthoven  [l]. 

An  immediate  consequence  of  this  additional  hypothesis,  in  the  presence  of 
our  previous  assumptions,  is  that  h(f(x))  is  now  quasiconcave  on  X  (see  e.g, 
Berge  [2,  p.  207]).  Although  (l)  now  becomes  susceptible  to  veurious  direct 
(non-parametric)  approaches  to  quasiconcave  programming,  the  approach 
represented  by  Th.  1  can  be  very  efficient  when  an  efficient  parametric 
programming  algorithm  is  available  for  (Pa)  —  especially  in  view  of  Theorem  3 
below. 

V  h(y)  is  quasiconcave  on  the  convex  set  F  if  and  only  if  (y  «  F;h(y)  >  k) 
is  a  conve::  set  for  all  real  k.  An  equivalent  definition  is  that 
b(t  y^  +  (l-t)  y^)  >  Min  (My"^),  h(y^))  for  all  y^,  y^  in  F  end  0  <  t  <  1. 
Simple  examples  of  quasiconcave  Increasing  h  are:  Min(yj^,y2}  ; 

^1*^2  —  ®^  and  y^^  .  for  — ®' 

5/  The  convex  hull  of  a  subset  of  Euclidean  space  is  the  smallest  convex  set 
containing  that  set. 
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Lemma  9' 

Let  solve  i  =  0,1,2,  where  0  <  <  a®  <  <  1  Then 

there  exists  a  number  t,  0  <  t  <  1,  such  that 

f^(x°)  >  t  f.(x^)  +  (1-t)  f.(x^),  i  =  1,2. 

Proof : 

i  i  0 

Lonote  fCx"^)  by  f  ,  i  =  0,1,2.  We  assume  that  r  does  not  coincide  with 

1  2 

either  f  or  f  ,  for  othenirise  the  conclusion  of  the  lemma  would  be 
trivially  true.  Suppose  that  the  conclusion  is  false.  Then  there  does 
not  exist  a  number  t  >  0  that  satisfies  the  following  system  of  inecuallties 
(9.1)  t{fl  ..  f^)  <  (f°  -  f^) 

{9,2)  t(f2  -  f|)  <  (fg  -  fl) 

(9.3)  t  <  1. 

By  a  ctandai'd  theorem  on  non-negative  solutions  to  linear  inequalities 

[U,  p,  by],  there  exist  non-negative  real  numbers  s^,  s^f  and  s^  such  that 

(10)  (4  -  f2)  -  fg)  =3>  0 

and 

(}1)  (f°  -  f^)  s^  +  (f°  -  f^)  Sg  +  <  0. 

Multiplying  ( ll)  by  -1  and  adding  the  result  to  (lO),  one  obtains 

(12)  (f^  -  f^)  s,  +  (f^  -  fp  S2>  0. 

Using  the  fact  that  >  0,  from  ( ll)  one  obtains 

(13)  (f^  -  f°)  s^  +  (f^  -  f®)  S2>  0. 

Now  s^  and  s^  cannot  both  vanish.  Divi'^ing  (l2)  and  (l3)  by  (s^  s^), 

recalling  that  s^,  5^  >  0,  end  defining  5  as  Bj^/(s^  +  b^),  one  obtains 

(14)  (f];  -  f°)§  +  (fg  -  fg)  (1  -  ^)  >  0, 

(15)  (f^  -  f°)§  +  (fg  -  fg)  (1  -  5)  >  0, 
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and  0  <  ^  <  1. 

Define  Vj(a)  =  +  (l  -  a)  j  =  0,1,2. 

By  the  definitions  of  x^,  -0,1,2,  v  (cy'^)  >  v.  ((y^)  for  j  =0,1,2  and 

J  —  K 

k  ^  j.  Thus 

(l6)  v^((y^)  -  v^(cy^)  >  0 

(it)  v^(a°)  -  v^(a°)  <  0 

(18)  V2(Q'^)  -  >  0 

(19)  Vr,{oP)  -  V  (a°)  <  0  . 

Now  (l4)  and  (l5)  may  he  written  as 

(20)  v^(^)  -  v^(S)  >  0. 

(21)  -  v^(^)  >  0. 

By  the  linearity  of  Vj^(q')  -  v^(fv)  in  O'  ,  (l6),  (iT;^  and  (20)  Imply 
that  S  <  0°  (recall  that  0^  <  O^),  Similarly,  (l8),  (l9);  and  (2l) 
imply  that  §  >  o°.  This  contradiction  implies  that  the  conclusion 
of  the  lemma  must  he  true, 

'Theorem  3; 

Assume  that  h  is  quaslcorcave  on  F.  If  x*((y)  is  any  optimal 
solction  function  of  (Pcv)  on  [0,l],  then  h(f(x*(Q')))  is  quasiconcave 
on  L0,l]. 

Proof; 

Let  0  <  ck-^  <  O'®  <  <  1,  and  let  e  X*(f/),  i  =  0,1,2.  By 

Lemma  9f  there  exists  a  number  t,  0  <  t  <  1,  such  that 
f.(x°)  >  t  f^(x")  +  (1-t)  f.(x^),  i  =  1,2  . 

Thus  h(f(x°))  >  h  (t  f(x^)  +  (l-t)  f(x^)) 

>  Min  {h  (f(x^)),  h(f(x^)))  , 
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where  the  first  inequality  holds  because  h  is  increasing  and 
the  second  because  it  is  quasiconcave.  This  shows  that  h( f(x*(o:)) ) 
is  quasiconcave  on  [o^l]. 

Theorem  3  often  makes  possible  a  considerable  simplification 
in  the  maximization  of  H(o')  on  the  unit  interval,  by  allowing 
part  of  the  interval  to  be  ignored  by  virtue  of  the  easy 

Corollary  3.1: 

If  eX*  (q?^)  and  x^  »iX*(Q'^)  ,  where  c?'  <  ,  then 

h(f(x^))  -  h(f(x^))  <  0  (rosp.  >  O)  implies  that  H(Q')  cannot 

1  2 

achieve  its  maximum  at  oi  <  a  (resp.  Q'>  o?  ) . 

EXEMPLARY  ALGORITHMS 

In  this  section  we  apply  the  results  of  the  last  (principally  Part 
D  of  Th.  2  and  Cor.  3.1)  to  show  how  known  parametric  programming  algorithms 
can  be  used  to  solve  (l)  in  the  manner  suggested  by  Th,  1.  For  illust¬ 
rative  purposes  we  choose  parametric  linear  programming  [5I,  Wolfe’s 
method  of  parametric  quadratic  programming  [l3];  and  Geoffrion's  method 
of  parametric  concave  programming  [6].  The  six  algorithms  presented 
below  are  given  in  outline  form^  with  no  attempt  made  to  give  details  of 
the  most  efficient  organization  ol  the  criuputations . 

Parametric  Linear  Programming 

In  ohis  subsection  we  assijme  that  and  f^  are  linear  end  that 

X  is  determined  '  '■  linear  inequality  constraints,  so  that  parametric 
linen  •  prog'^araming  '.an  be  used  to  produce  an  optimal  solution  function 
x-(o:)  for  (POf)  on  [0,l],  It  is  well  known  that  x*(<>)  will  be 
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piecewise  constant,  and  that  without  loss  of  generality  it  can  to 
assumed  to  be  of  the  form 

x*(q')  =  for  <  a  <  ,  i  =  0, N, 

where  0  <  cf"  <  . . .  <  <  1  (M  finite  and  possibly  O)  are  the 

points  of  discontinuity  and  \re  have  put  cf'  =  0  and  =  1.  Also, 

x*(l)  =  ,  Thus  by  Th.  2D  we  have  H(q^)  -  h(f(x^))  for  <  o  < 

i  =  0,  ...,K  ,  H(0)  =  h(f(x°))  ,  and  H(i)  =  h(f(x^)).  If  N  =  0,  then 
obviously  x°  is  optimal  in  (l).  If  N  >  1,  then  we  have  x(‘^^)  = 
and  x*(o^^)  =  x^  for  i  =  1,...,  N;  consequently,  (3.1)  and  (3.2) 
become 

(22)  H(o'^)  =  Maximum  h(f(t  x^  ^  +  (l-t)  x^  )) 

te[0,l] 

(23)  H(Q^^)  =  Maximum  h(t  f(x^*^)  +  (l-t)  f(x^)  ) 

te[0,l] 

for  i  =  1,...,  N.  Since  x-^(a)  is  piecewise  constant  \re  see  that 

v.hen  11  >  1,  H(o')  achieves  its  maximiim  at  a  point  of  discontinuity  ; 

i  -1  i 

therefore  the  point  t*  x  *  +  (l-t*)  x  *  is  optimal  in  (l),  where 

t*  satisfies  H(q;^*)  =  h(f(  t*  x^*  ^  +  (l-t*)  x^*  ))  or,  alternatively, 
H(q;^*)  =  h(t*  f(x^"'-  '  ^)  +  (l-t*)  f(x^*)  )  (cf.  (5)  and  (6)).  Vie  thus 
obtain  the  following  algorithm. 

Algorithm  1 

Step  1.  Solve  (P(>)  by  parametric  linear  programming  to  obtain 
and  x^,  i  =  0,  ...,N,  computing  the  quantities  H(q^^), 
i  =  1,...,  H  by  (22)  or  (23)  as  the  calculations  progress. 
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If  N  =  0,  stop-  x°  is  optimal  in  (l).  If  I!  >  1, 
then  go  to  step  2. 

Step  2.  Let  he  the  largest  of  the  quantities  computed 

at  stop  1.  Then  t*  ^  (l-t*)  x^*  is  optimal  in 

(l),  where  t*  is  defined  as  in  the  text  so  as  to  achieve 
Stop. 

If  h  is  quasiccncave,  then  due  to  the  consequent  quasi  concavity 
of  H(»)  it  is  rarely  necessary  to  solve  (Po?)  on  the  entire  unit 
interval,  or  to  compute  all  of  the  H(o'").  "n  Algorithm  2,  which 
exploits  the  quasiconcavity  of  n,  it  is  assumed  for  simplicity  of 
exposition  that  the  parameter  o:  increases,  starting  from  the  value 
0,  A  similar  algorithm  can  easily  he  constructed  to  cover  the  more 
general  case  in  which  has  an  arbitrary  starting  value  and  can 
decrease  as  veil  as  increase  (the  closer  the  starting  value  is  to  the 
one  that  maximizes  H(w),  the  less  work  is  required  to  solve  (l)  hy 
this  approach).  This  came  remark  applies  to  Algorithms  4  and  6. 

Algorithm  2 

Step  1,  Solve  (Po)  to  obtain  x^  .  Put  1=0  and  ^  =  1. 

Step  2,  Solve  (Pcf)  by  parametric  linear  programming  as  O'  in¬ 
creases  above  until  either  0=1  or  is 

encountered.  In  the  first  case,  go  to  step  4;  in  the 

T+1 

second,  determine  x  and  go  to  step  3. 

T  T+ 1 

Step  3.  Compare  h(f(x  ))  with  h(f{x  )): 

a.  If  h(f(x^))  <  h(  f(x^'*'^)),  increase  I  by  1, 
put  I  =1.  ;'nd  return  to  step  2- 
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b.  If  hCitx^))  =  h(f(x^^^)).  Increase  I  by  1  and 
return  to  step  2: 

c.  If  h(f(x^))  >  b(f(x^^^)),  increase  I  by  1  and 
go  to  step  H. 

Step  U,  If  I  «  C,  stop;  x°  is  optimal  in  (l).  If  I  >  1>  then 
compute  by  (22)  or  (23)  and  find  the  largest  of  the 
quantities  H(of^)  (I  <  1  <  !)•  If  bhe  maximum  is  achieved 
for  H(Q(^*),  then  t*  x^*  +  (l-t*)  x^*  is  optimal  in 

(l),  vhere  t*  is  defined  as  above  so  as  to  achieve 
H(Q(^*).  Stop. 

Remark; 

In  both  of  these  cdgorithms,  a  one>dimensional  maximization 
problem  ((22)  or  (23))  must  be  solved  each  time  an  H(a^)  is 
required.  Frequently  these  cne-dimensional  problems  are  trivial;  but 
even  when  they  are  not,  various  methods  are  available  ti2].  When 
h  is  quasiconcave,  Fibonnacci  search  is  particularly  attractive. 

Pprs.^etric  Quadratic  Programming 

In  this  subsection  wr-  aosiuae  that  fj^(x)  is  linear,  that  f2(x) 
is  a  negative  semi -definite  quadratic  form,  and  that  X  is  determined 
by  linear  inequality  constraints.  Then  (Pof)  can  be  solved  on  (o.lj 
by  Wolfe’s  method  of  parametric  quadratic  programming  (his  so-called 
"long  form")  [l3],  among  others,  for  an  optimal  solution  function 
x*ioi)  that  is  continuous  on  [o,  ll.  By  Th.  2.D.1,  H(a)  ■ 
h(f(x*(a)))  on  [O, l],  and  therefore  the  point  x*  in  the  image  of 
[o,l]  voider  x*(of)  which  maxlmizee  h(f(x))  is  also  optimal  in  (l). 
ITow  from  Wolfe's  results  it  follows  easily  that  this  image  set  is 
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of  the  form  x^,x^  ,  where  x^,x^  is  a  line  segr.ent  in 

E*^  with  endpoints  x^  and  x^*^  and  N  is  a  finite  positive 
integer.  The  points  x^(l  =  0,1, ...,N  +  l)  are  determined  serledly, 
in  order  of  increasing  superscript,  from  the  modified  Simplex  procedure 
employed  hy  Wolfe  ^  (x^  ^  x*(g'^  )  for  certain  satisfying 

o  -  Qf°  <  <y^  <  ...  <  <  0^'*^  =  l);  a  termination  signal  accompanies 

Ktl 

the  determination  of  x  .  Putting  these  ohservations  together, 
we  obtain 

Algorithm  3 

Step  1.  Solve  (Fur)  on  [0,l]  by  Wolfe's  method  to  obtain 

x^,  i  =  0,1,...,^'*’  1  »  computing  the  quantities 

-  Maxlmvun  h(f(X  x^”^  +  (l-^)  x^)),  1  ■  1,...,IH-1, 

0<X<  1 

as  the  calculations  proceed. 

Step  2.  If  is  the  largest  of  the  (ties  are  immaterial) 

then  X*  x^*”^  ♦  (l-X*)  x^*  is  optimal  In  (l),  where 
X*  satisfies  »  h(f(X*  x^*  +  (l-X*)  x^*))  , 

If  h  is  quasiconcave,  then  so  is  h(f(x*(°')))»  and  an  im> 
pro-’  ed  version  of  Algorithm  3  can  be  constructed  that  bears  much 
the  same  relation  to  It  as  Algorithm  2  does  to  Algorithm  1: 

Algorithm 

Step  1.  Solve  (Po)  and  obtain  x°  by  Wolfe's  method.  Put 
1*1  ani  1*0. 


^  Actuall;/’,  Wolfe's  algorithm  Is  addressed  to  a  reparametcrized 
version  of  (Pa)  that  uses  X/X+i  on  [0,«»]  in  place  of  a 
on  [0,l].  But  this  causes  no  essential  difficulty. 
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Step  2.  If  I  ■  N  +  1,  go  to  step  U:  otherwise,  determine 
by  Wolfe's  method  imd  go  to  step  3. 

Step  3.  Compere  h(f(x^))  with  h(f(x^^^)); 

a.  If  h(f(x^))  <  h(f(x^'*^^)),  increase  I  by  1, 
put  I  “  I»  and  return  to  step  2; 

b.  If  h(f(x^))  h(f(x^*^)),  increase  I  by  1 

and  return  to  step  2j 

c.  If  h(f(x^))  >  h(f(x^*^)),  increase  I  by  1  and 
go  to  step  i;. 

Step  4.  Compute  the  quantities  =  Maximum  h(f(Xx^*^  +  (l-^)  x'^)), 

I  <  i  <  I  .  If  0^*  is  the  largest  (ties  are  inmaterial), 
then  X*  x^*”^  +  (l-X)  x^*  is  optimal  in  (l),  wherr.’  >.* 
satisfies  T\^*  »  h  (f(X*  x^*"^  ♦  (l-X)  x^*))  . 

The  remark  following  Algorithm  2  is  appropriate  here  also  with 
regard  to  computing  the  especially  when  h  is  quasiconcave  ... 
for  then  h(f(X  +  (l-X)  x^))  is  quasiconcave  in  X  on  [0,lj. 

Parametric  Concave  ftrogramming 

When  X  is  determined  by  concave  inequality  (>)  constraints 
»nd  certain  additional  hypotheses  are  satisfied,  Geofftrion's  method 
[6]  can  be  used  to  srl/e  (For)  on  [o,l].  The  x*(cO  so  produced 
is  continuous,  and  so  by  Th.  2J).l.  it  follows  that  H(a)  »  h(f(x*(^))) 
on  [o,ll  , 


24 


Algorithm  5 

Solve  (?»)  on  [o.l]  by  Geoffrion’s  method  to  obtain 
x*(a),  all  the  while  evaluating  h(f(x*(ci^))  ) ,  Determine  the 
value  O'*  at  whjch  h(f(x*(o!') ))  achieves  its  maximum  on  [o,l]  . 
Then  x*  (a-)  is  optimal  in  (l). 

If  h  is  quasiconcdve,  then  as  before  (Pof)  does  not 
ordinarily  have  to  be  solved  on  the  entire  unit  interval: 

Algorithm  6 

Step  1.  Solve  (Po)  by  Geoffrlon’s  or  some  other  method  to 
obtain  x*(o). 

Step  2,  Determine  x*(q')  as  ck  increases  above  0  by 
Geoffrion's  method,  all  the  while  evaluating 
h(f(x*(Q')) ),  until  a  value  Q?*  is  encountered  above 
which  h(f(x*((>)))  begins  to  decrease.  Then 
s  optimal  in  (l), 

Algorithrae  'jJ  and  6  are  not  limited  to  Geoffrion’s  method,  of 
course,  but  apply  equally  well  to  any  parametric  concave  programming 
algorithm  that  produces  a  continuous  optimal  solution  x*(cr)  to 
(pa)  on  (0,1]. 


EXTEInISIOKS 

In  mathematical  programming  with  one  objective  function,  the 
convention  is  usually  made  to  discuss  only  maximization  problems 
or  only  minimization  problems,  for  the  results  for  one  class  of 
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problems  are  directly  applicable  to  the  other  vhen  appropriate  slsn 

changes  are  made.  The  sane  situation  provalls  here.  We  have  chosen 

to  discuss  the  case  vhere  both  are  being  maxlmlted>  but  our 

results  are  applicable  to  the  other  cases  (min  min  min 

max  f2?  max  min  fg)  vlth  appropriate  sign  changes.  If  h  is 

increasing  in  but  decreasing  in  fg,  for  example^  define 

f^  as  -  f 2  and  h*(fj^,fp  as  h(fj^,-(-f2)).  Then  h'  is 

Increasing  in  both  f^  and  f^>  and  if  f^  is  concave  (this  is 

true  if  and  only  if  fg  is  a  convex  function)  then  ovir  results 

apply  if  h'  is  used  in  place  of  h  and  f^  is  used  in  place 

of  f 2  .  As  an  example  of  the  application  of  this  idea*  consider 

the  "linear  fractional"  programming  problem.^ 

Maximize  (cx  ♦  Y)/(dx  +  ?)  subject  to  Ax  <  b,  where  c  and  d 

X  >  0  * 

are  n- vectors,  b  is  an  m-vector,  A  is  an  m  x  n  matrix,  and  Y  and 

6  are  scalars.  We  assume  for  simplicity  that  f^(x)  ^  ex  *  y  and 

fgCx)  s  dx  6  are  strictly  positive  for  all  feasible  x.  Defining 

h  «  f^(x)/f2(x),  ve  observe  that  h  is  increasing  in  f^(x)  but  decreasing 

in  fgCx).  Thus  ve  consider  h'  and  fg',  defined  as  above,  in  place  of 

h  and  fg.  Since  it  is  easily  ^een  that  h*  is  quasiconcave  and  that 

f^  and  fg  S  (•^)are  linear.  Algorithm  2  applies,  thereby  providing  a 

procedure  for  solving  the  linear  fractional  program  by  means  of  parametric 

7/  The  linear  fractional  prograeiming  problem  is  due  to  Isbell  and 
Marlov  [7,  p.  82].  Several  methods Ibr  solving  such  programs  ere 
available,  most  of  them  based  on  linear  programming  techniques. 

For  a  brief  guide  to  the  literature,  see  Joksch  [8,  p.  197]. 
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linear  progrananing.— '  Note  that  (22)  and  (23)»  which  are  used  by 
Algorithm  2>  are  paz^icularly  simple  in  this  case.  If  dx  '**  6  is  replaced 
by  a  positive  semi -definite  quadratic  forrn^  then  by  similar  reasoning  we 
see  that  Algorithm  If  provides  a  method  for  "linear /quadratic  fractional" 
programming. 

A  trick  sometimes  useful  in  ordinary  mathematical  programming  is  to 

perform  a  nonlinear  change  of  scale  on  the  criterion  function  in  order 

to  make  it  concave  (a38\mlng  that  it  is  to  be  maximized)  or  of  a  simpler 

functional  form^  so  that  an  available  algorithm  can  be  applied.  For 

n  ^1 

example,  to  minimize  q^^  over  x  >  0  satisfying  Ax  <  b,  where 

qj^  >  0  (l  *1,  ...,n),  it  is  more  convenient  to  minimize  lji(n”^^  q*^)  ■ 

x^(ln  q^)  Instead  because  then  linear  programming  can  be  used.  In 

the  remainder  of  this  section  we  shall  show  that  this  idea  can  be  Tised  to 

greatly  extend  the  power  of  the  jnresent  method  of  bi-crlterlon  porogrammlng. 

Define  the  scale-modified  parametric  sub-problem 

(?“)  Maximize  a  g^(f  (x))  ♦  (l-af)g2(f2(x)), 

X  <  X 

where  the  g^  are  henceforth  assumed  to  be  strictly  increasing,  differentiable 
functions  defined  at  least  on  f^[X].  We  shall  also  assume  that  g^(f^(x)) 
is  concave  (a  sufficient  but  not  necessary  condition  for  which  Is  that 
g^  be  concave)  sid  for  simplicity  that  the  f^^  are  differentiable.  We  denote 
the  optimal  solution  set  of  (P  o)  by  X(tt). 

In  the  sequel  h  is  not  assumed  to  be  quasiconcave  except  in  Ifaeorem 
3A.  We  shall  obtain  counterparts  of  Lemmas  2  and  3  and  Theorems  1,2,  and  3. 
lemma  2A; 

If  x°  is  efficient,  then  there  exists  a  number  in  the  unit  Interval 

such  that  x°  is  an  optimed  solution  of  (P  cr^). 

8/  The  assumption  that  (fj^(x),  f2(x))  Is  In  the  Interior  of  the  positive 
orthant  for  all  feasible  x  can  be  releuced,  at  the  expense  of  sll^tly 
modifying  Algorithm  2,  to  the  minimal  requirement  that  dx  -t  6  j4  o 
for  cdl  feasible  x. 
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Proof; 

Since  x°  Is  efficient,  by  Lenma  2  there  exists  a  n’-imber  v  in  the 

unit  interval  such  that  x°  is  an  optimal  solution  of  (Pv).  Because 

of  the  concavity  of  vf^(x)  +  (l-v)  fgCx), 
we  therefore  have 

(24)  y V  yx)  +  (l-v)  f2(x))  (x-x°)  <0,  V  X  e  X, 

where  is  the  gradient  operator.  Put 

(v/g,(f,(x°))) 

“o-  - 

(v/g^  (yx°)))+  ((1  v)/g^  (yx®))) , 

where  g|  (f^(x®))  is  the  first  derivative  of  g^^  evaluated  at  f^(v®). 

Since  g^  is  strictly  increasing,  we  have  gj(fj^(x°))  >0,  i  =  1,2. 

Hence  Qf  is  in  the  unit  interval.  To  show  that  x°  is  optimal  in 

o 

•w 

(P  Of  ),  because  of  the  concavity  of  ct  g,(f.(x))  +  (l-of  )  gJf«(x))  on 
r>  o  X  x  o  ci  (Z 

X  it  is  equivalent  to  show 

(25)  gjCfjCx”)))  {r.-x^)  <  0,  V  X  c  X. 

By  the  definition  of  Qf  ,  the  gradient  vector  in  (25)  is 

o 

(l/S)  ((v/gi  (f^(x‘>)))  gl(f^(x'’))  ♦ 

(d-v)/  gj  (fj(x‘’)))  gj(f2(x‘’)) 

vhere  B  .  (v/g^  (fj(x“)))  +  ((l-v)/g^  (fgCx”))). 

Upon  cancelling  and  observing  that  3  ^  0,  we  see  that  (2U)  follovrs 
from  (25). 

Lemmas  1  end  2A  imply 
Theorem  lA; 

An  optimal  solution  of  (l)  is  found  among  the  optimal  solutions  of 
(P  a)  for  some  Qf  in  the  unit  interval.  More  precisely,  if  Qf*  is 
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optimal  in 

(2A)  Maximize  ff  (o^)  > 

a  e  [o,l] 

where  we  define 

(3A)  H  (or)  =  Maximum  h(f(x)), 

X  e  jr  (a) 

then  (l)  is  solved  hy  any  point  x  e  X  (cr*) 
satisfying  h(f(x))  =  H  (of*). 

We  also  have 

Lemma  3A; 

Every  point  of  X(a)  is  efficient  when  Qf  satisfies  0  <  or  <  i.  Some 
point  of  X  (a)  is  efficient  when  a  ■  0  or  1. 

To  knoT-'  how  to  compute  H(»)  economically,  we  require  the  following 
version  of  Th.  2. 

Theorem  2A; 

A.  Let  ot  be  fixed  In  [0,l].  If  (P  a)  has  a  unique  optimal  solution 
x(«),  then  H  (c»)  »  h(f(x  (®))). 

E.  H  (O)  =  h(f(x))  for  aiiy  efficient  point  x  e  X  (o). 

H(i)  =  h(f(x))  for  any  efficient  point  x  «  X  'l). 

C.  Assume  that  gj^(f^(x))  or  or  both  is  linear  on  a  line 

segment  of  X  only  if  it  is  constant  on  it.  Then  for  each  Qf 
satisfying  0  <  Qf  <  1,  we  have  !?(«)  m  h(f(x))  for  any  point 

X  e  X  (Of). 

D.  Let  x(Qf)  be  any  optimal  solution  function  for  (P  ot)  on  lO,  l] 
that  is  continuous  everywhere  except  possibly  for  a  finite  number 
ntimber  of  simple  discontinuities.  For  each  point  or*  of  discontinuity. 
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define  x  (or')  and  x  (of)  as  the  left-hand  (unless  oi>  =  o)  and 

right-hand  (unless  «•=  l)  limits  of  x  (of)  at  a',  respectively. 

Then 

1.  H  (a)  =  h(f(x(Qf)))  at  every  point  of  continuity  in  [0,l]. 

2.  H  (o)  =  h(f(x  (o))  )  if  0  is  e  point  of  discontinuity. 

3.  H  (l)  =  h(f(x  (o))  )  if  1  is  a  point  of  discontinuity. 

4.  If  or'  is  a  point  of  discontinuity  satisfying  0  <  o'  <  1,  then 


(3.1A) 

H(a' )  = 

Maximum 

h(f(t  x(a')  +  (l-t)  X  (cK')))  and 

t  e  [o,l] 

(3.2A) 

i?  (a»)  = 

Maximum 

h(s‘\tg(f(x(o<')))  +  (l-t)  g(f(:(Q")))  )) 

t  e  [0,1] 

Proof : 

The  proof  of  this  theorem  will  not  be  given  in  detail  here,  inasmuch 
as  it  follows  closely  that  of  Hi.  2.  The  key  observation  is  that 
(P  o)  has  all  of  th#-  properties  that  (P  a)  does,  if  we  view  g(f)  in 
(P  o)  as  taking  the  place  of  f  in  (P  o).  Thus  Lemmas  4  through  8 
hold  with  regeird  to  (P  »)  if  their  statements  are  modified  by  replacing 
everywhere  *- superscripts  by  tildes  and  f  by  g(f).  To  relate  the 
results  regcu’ding  (P  a)  to  h(f(x(o))),  it  is  necessary  to  observe  that 
h(f(x))  5  h(g"\g(f(x)))),  where  g"^  =  (g^\  g2^).  The  (single- valued) 
inverse  functions  g”^  exist  because  the  g^  are  strictly  increasing. 
Theorem  3A; 

Assume  that  h  is  quaisiconcave  on  F.  If  x(of)  is  any  optimal  solution 
ivnction  of  (P  «)  on  [0,l],  then  h(f(x(a)))  is  quasiconcave  on  [o, l]. 
Proof: 

Let  cr\  cr°,  and  satisfy  0  <  <  1,  and  let  x^  be 

in  X  (Q^),  i  =  0,1,2.  If  f(x®)  =  f(x^)  or  f(x°)=  f(x^),  then 
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obviously  h(f(x°))  >  Min  {h(f(x^)),  h(f(x^))).  We  shall  show  that 

o  1.  o  2 

this  conclusion  holds  when  f(x°)  ^  f(x  )  and  f(x'^)  4  )»  therebv 

showing  that  h(f(x(cr)))  is  quasiconcave  on  [0,l]. 

If  0  <  Qf^  <  <1,  then  x^  and  x°  are  efficient  and  by 

Lemma  2  there  exist  ^  in  the  unit  interval  such  that 

x^  s  i  =  0,1.  It  follows  from  Lemma  6a,  which  implies  that 

g(f(x(Q^)))  is  monotone  in  a,  the  fact  that  f(x^)  ^  f(x^),  the 

strictly  increasing  nature  of  g,  and  <  cP ,  that  .  If 

cr^  =  0,  th'jn  clearly  x^  c  X*(0).  Thus  for  0  <  <  Qf°  <  i  we 

have  the  existence  of  and  ^  satisfying  0  <  <  1  such 

that  x^  €  X*(^^),  i  =  0,1.  By  similar  arguments  we  obtain  thab 

for  0  <  oP  <  <  1  there  exists  satisfying  <  1 

2  2 

such  that  X  «  X*(  X  ) .  Applying  Lemma  9>  we  find  that  there  exists 
a  number  t,  0  <  t  <  1,  such  that  fj^(x°)  >  tfj^(x^)  +  (l-t)  f^(x^), 
i  =  1,2.  Hence 

h(f(x°))  >  h(t  f(x^)  +  :i-t)  f(x^)) 

>  Min  {h  (f(x^)),  h(f(x^))  ), 

where  the  first  inequedlty  holds  because  h  is  Increasing  and  the 
second  because  h  is  queslconcave.  The  proof  is  complete. 

Theorems  lA,  2A,  end  3A  can  be  used  in  the  same  manner  as  were 
Theorems  1,  2,  and  3  to  construct  algorithms  for  solving  (l)  via  (P  Qf). 
The  freedom  to  perform  nonlinear  scede  changes  on  the  f^  can  be  used  to 
extend  the  applicability  of  the  taiown  parametric  programming  algorithms. 
As  an  example,  consider  the  problem 
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Minimize  v,  R.  ^  q  J 

X  >  0  ^  Ij 


>'1  .  n" 

Ij  ''S  "  X 


subject  to  Ax  <  b  , 


where  the  q.  .  and  v's  are  strit,tly  positive.  Problems  of  this  sort 
^  J 

arise  in  redundancy  allocation  and  target  -  assignment  contexts.  VJhile 
(26)  can  be  approximated  as  a  linearly  separable  convex  program  by  :ri 
appropriate  change  of  variables  [ll,  p.  350 ],  we  shall  indicate  how  it  can 
be  ipolved  via  parametric  linear  progrmming.  By  mailing  the  obvious 


identifications 


H  =  f  1  +  f^ 


fi(x)*-^.  q.^;  ,  i  =  1,2 

X  =  l*x>0  :  Ax<b}  , 

we  see  that  (26)  is  a  problem  of  the  form  (l).  Tiie  obvious  scale  change 
to  apply  to  the  f^  is  the  logarithmic  one:  g^(y)  =  -  In  (-y),  i  =  1,2. 
Theorems  lA,  2A,  and  3A  then  apply,  and  Algorithm  2  can  be  used  to 
solve  (l)  by  parametric  linear  programming  applied  to  the  linear 


Dub -problem 


Maximize  a;  zf]  x .  (-In  q..)  +  (l-Q^)  x.(-ln  q^  • ) 


subject  to  Ax  <  b. 


The  stochastic  programming  model  of  Kataoka  [lO]  can  be  solved  by 
a  scale-change  that  leads  to  the  applicability  of  Algorithm  U. 
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